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ABSTRACT 



TITLE: Development of Evaluation Instrument to Determine Effectlveneee of 

"World of Work" Program 

INSTITUTION: Bethel School District #52 

PROJECT DIRECTOR: Earle E. Vossen 

Address: 1801 Echo Hollow Road, Eugene, Oregon 97402 
Phone : 689-0731 

PROJECT DURATION: 14 June, 1972 - 1 July, 1972. 
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NUMBER OF STUDENTS AFFECTED: 1825 
EDUCATIONAL SETTING 



NUMBER OF STAFF INVOLVED: 76. 



School District //52 has 1,825 elementary students in grades 1-6 and is 
located N.W. of Eugene with about half of the district within the city 
limits of Eugene. The main industries are lumber processing, railroad 
car switching and repair; warehousing, and farming. Five elementary 
schools feed into two Junior highs. 



PURPOSE 

The purpose of the project was to develop evaluation instruments for each 
grade level which would determine the effectiveness of the career aware- 
ness instruction offered Bethel elementary students through the use of the 
"World of Work" program. 

PROCEDURES AlU) OUTCOMES 

The project involved teachers from each grade level developing a format 
for the evaluation instruments, and devising questions which would satis- 
factorily determine the effectiveness of the "World of Work" program to 
all attain the behaviorial objectives established for each grade level. 

Activities: Two 3-hour planning sessions to establish format held during 
May 1972. Three days developing and writing pilot test forms during 
June 1972. Preliminary test form administered to students, and results 
compiled in September 1972. Results of testing and comments of teachers 
administering the tests studied by the committee. 

Outconas: Tests were too easy for some grade levels, too difficult for the 
other grades. Preliminary work on revising the tests was completed when 
decision was reached by the district to adopt a new Social Studies program. 
Revision of the "World of Work" guide will be necessary before additional 
work on the evaluation is continued. 
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!• BACKGROUND AND EDUCATIONAL SETTING 

Bethel School District is a consolidated system consisting of five 
elenentary, two junior highs (grades 7-9), and Willamette High School. 
Total student enrollment for the district is 3385 students. About half 
of the school district is within the Eugene city limits, and the other 
half is spread out with ^railroad yards, farm lands, industry (mainly 
lumber products), and suburban residential areas intermingled. A high 
percent of the patrons are middle class and have employment outside the 
district. 

The school district supports a innovative and progressive program 
of education. It has been very sensitive to the needs of the handicapped, 
the non-college as well as college bound students. 

A program of career awareness was initiated in the elementary grades 
about five years ago. After two years it was decided that it should be re- 
vised with an emphasis on establishing behaviorial objectives for each grade 
level 1-12 under the title of "World of Work" guide for grades 1-12. The 
program was fully implemented during the 1972-73 school year at all grade 
levels: grades 1-6 Career Awareness, grades 7-9 Exploration, and 10-12th 
Enrichment and Decision Making. 

Any educational program, especially a new one being fully implemented 
at all grade levels , by a group of teachers with a great variety of train- 
ing and experience backgrounds needs to be observed very carefully, and to 
have a well developed plan for measuring how successful it is in achieving 
its goals. With these needs in mind it was decided that some form of evalua- 
tion instruments should be developed, tested, and the results carefully 
studied to determine if any changes are needed. 

II. PROCEDURES 

A conunittee of seven teachers, the Coordinator of Career Education, and 
Larry Veal, consultant, held two planning meetings during May 1972 to develop 
a basic philosophy, establish a format and some guidelines. Scheduling the 
planning sessions while the teaching staffs? were still available made it pos- 
sible for the committee to solicit suggestions from fellow teachers. The com- 
mittee provided representation of all grades, one through six. 

By the time the committee met in June they were well fortified with ideas 
and quickly set upon the task of producing a set evaluation instruments in 
three days that could be pilot tested in September 1972. 

During inservice prior to school opening, training sessions were held at 
each grade school to impress upon the teachers the importance of them follow- 
ing the same exact steps in administering the tests and accumulating the ad- 
ditional information. 

The evaluation instruments were administered and the results compiled 
by the end of October. Teachers were asked to keep a record on the time 
necessary for administration of each test, and any words included in the 
instructions, or the test which the students indicated they did not under- 
stand. 



ERLC 



The Committee met in February 1973 to discuss the findings, and 
decide what changes would be necessary* 

III. RESULTS OF PROJECT 

The time necessary to administer the tests ranged from 13 - 19 minutes 
which indicated that they were not too long even though the teacher read 
the instructions, each question, and the choice of answers. The questions 
were read so as to eAininate the reading ability factor as much as possible • 

Initially, there was considerable concern over the lengthy list of words 
that students indicated they did not know. After considering that it was 
actually administered as a pre-test it was dPxided although some changes in 
vocabulary should be made, that it might be. better to wait until the test 
was given as a post-test. 

Analysis of the test results indicat;^d that the instruments at some 
grade levels are too easy, and fail to give a true measure of the better 
students knowledge of careers I 

Questions at the 5th and 6th grade level are too social studies 
oriented, and there is a need for extensive revision. More emphasis should 
be placed on careers, tools, and services and less on products. 

Copies of outside evaltiPtions by John Davies and Virginia Jeffersen are 
attached. They strongly reinforce the findings of the Committee, and will 
be incorporated in the revision of the instruments. 

IV. CONCLUSIONS AND RECOMMENDATIONS 

The fact that a new social studies adoptions for the elementary schools 
will be adopted for introduction in the fall of 1973-74 school year means 
that the Bethel "World of Work" guide will have to be revised if the social 
studies program is to serve as the vehicle for the career awareness program. 

The Holt, Rhinehart Program has been adopted for the 4th, 5th, and 
6th grades, and a decision ha*; been postponed on what whill be selected for 
the first three grades. Examination of the adoptions for the 4-6th grades 
clearly indicate that extensive revision of the guide and the evaluation 
instruments will be necessary, and will be initiated during the 1973-74 
school year. Finalization would be completed during the summer of 1974. 

The experience gained by the committee, in the production of the 
guide and the evaluation instruments was very valuable. It will be of 
considerable value during the revision of the materials. 

V. SUMMARY 

The results and the experience obtained in developing and pilot testing 
have provided excellent background information and knowledge to the committee, 
and should make their task of revising the program, and the testing instru- 
ments an easy task. 
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-The ability to devise a method of testing 1st grade non-readers has 
greatly increased the acceptancy by all teachers of the evaluation in- 
struments. The initial reaction was a defensive one, but after administer** 
ing the tests, and seeing the results it will be an easier task to gain 
their cooperation while developing the revised forms. 

VI. DEMOGRAPHIC AND STATISTICAL INFORMATION 

a. Number of schools involved 5 

b. Total numbers of students enrolled in project schools 1825 

c. Total number of students directly served by the project 1825 

d. Number of staff directly involved in or served by the project 

Professional/certified 76 . 

Classified 2 . 

e. Estimated parents involved 0 

f . Estimated number of community persons and resource people involved 0 

g. Estimated number of visitors to the project 0 

h. Number of presentations on the project presented 

In-district 6 . 

Out-of-district 1 . 

1. Total number of guides, handbooks, materials developed 6 sets of tesi n 



Tests - 500 per grade level 1-6 

Instruction sheets for administering tests 6 sets. 

Records — Sheets 125 copies. 

Answer Sheets 125 copies 
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VII. SUMMARY OF COSTS 

A. Source of Funds 



State/Federal 
Local 
Total 

B. Breakdown of Costs State/Federal 

1. Administration 

2. Staff Development 

Workshop $1,500. 
Released Time 

Other 

Total 

3. Supplies and Materials 

A. Travel, per diem 

5. Consultants 

6. Evaluation 

7. Other Costs 

Total $1,500.00 



$1,500.00 
612.00 
$2,112.00 



Local 



156.00 



230.00 



226.00 
$612.00 



Total 



1,656.00 



230.00 



226.00 
$2,112.00 
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